A Reinforcement Learning-driven Translation Model for Search-Oriented Conversational Systems

Search-oriented conversational systems rely on information needs expressed in natural language (NL). We focus here on the understanding of NL expressions for building keyword-based queries. We propose a reinforcement-learning-driven translation model framework able to 1) learn the translation from NL expressions to queries in a supervised way, and, 2) to overcome the lack of large-scale dataset by framing the translation model as a word selection approach and injecting relevance feedback in the learning process. Experiments are carried out on two TREC datasets and outline the effectiveness of our approach.Comment: This is the author's pre-print version of the work. It is posted here for your personal use, not for redistribution. Please cite the definitive version which will be published in Proceedings of the 2018 EMNLP Workshop SCAI: The 2nd International Workshop on Search-Oriented Conversational AI - ISBN: 978-1-948087-75-

Définition et exploitation des méta-rôles des utilisateurs pour la recherche d'information collaborative

National audienceLa recherche d'information collaborative est un processus particulier impliquant un ensemble d'utilisateurs partageant un même besoin en information. Dans ce contexte, l'exploi-tation de la division du travail au travers des rôles est une des techniques utilisées pour structu-rer la session de recherche et optimiser son efficacité. Dans ce papier, nous proposons d'étudier les caractéristiques de comportement d'une paire de collaborateurs sur la base d'hypothèses de leur complémentarité. Nous définissons ainsi la notion de rôles latents qui sont (a) détectés en temps réel et (b) ensuite réinjectés dans un modèle d'ordonnancement de documents. Les expérimentations, menées sur des fichiers logs de sessions de collaboration réelles impliquant des paires d'utilisateurs, mettent en évidence l'efficacité de notre approche comparativement à des stratégies de recherche individuelles ou à celles qui considèrent des rôles fixes. ABSTRACT. Collaborative information retrieval is a particular setting involving a set of users sharing the same information need. In this context, the application of the division of labor policy through collaborators' roles is generally used in order to structure the search session and enhance its retrieval effectiveness. In this paper, we propose to analyse the search features of pairwise collaborators allowing to identify their implicit roles according to research hypothesis based on their complementarity. We define the notion of collaborators' meta-role which is (a) identified in real time, and (b) reinjected within a collaborative document ranking model. The experimental evaluation performed on search logs of real collaborative search session involving pairs of users highlights the effectiveness of our model with respect to individual-based or fixed roles-based search sessions. MOTS-CLÉS : recherche d'information collaborative, rôles, modèle d'ordonnancement, complé-mentarité des comportement

Collaborative Information Retrieval: Concepts, Models and Evaluation

International audienceRecent work have shown the potential of collaboration for solving complex or exploratory search tasks allowing to achieve synergic effects with respect to individual search, which is the prevalent information retrieval (IR) setting this last decade. This interactive multiuser context gives rise to several challenges in IR. One main challenge relies on the adaptation of IR techniques or models [8] in order to build algo-rithmic supports of collaboration distributing documents among users. The second challenge is related to the design of Collaborative Information Retrieval (CIR) models and their effectiveness evaluation since individual IR frameworks and measures do not totally fit with the collaboration paradigms. In this tutorial, we address the second challenge and present first a general overview of collaborative search introducing the main underlying notions. Then, we focus on related work dealing with collaborative ranking models and their effectiveness evaluation. Our primary objective is to introduce these notions by highlighting how and why they should be different from individual IR in order to give participants the main clues for investigating new research directions in this domain with a deep understanding of current CIR work

Understanding the Impact of the Role Factor in Collaborative Information Retrieval

International audienceCollaborative information retrieval systems often rely on division of labor policies. Such policies allow work to be divided among collaborators with the aim of preventing redundancy and optimizing the synergic effects of collaboration. Most of the underlying methods achieve these goals by the means of explicit vs. implicit role-based mediation. In this paper, we investigate whether and how different factors, such as users' behavior, search strategies, and effectiveness, are related to role assignment within a collaborative exploratory search. Our main findings suggest that: (1) spontaneous and cohesive implicit roles might emerge during the collaborative search session implying users with no prior roles, and that these implicit roles favor the search precision, (2) role drift might occur alongside the search session performed by users with prior-assigned roles

Collaborative Information Retrieval: Frameworks, Theoretical Models, and Emerging Topics

International audienceA great amount of research in the IR domain mostly dealt with both the design of enhanced document ranking models allowing search improvement through user-to-system collaboration. However, in addition to user-to-system form of collaboration, user-to-user collaboration is increasingly acknowledged as an effective mean for gathering the complementary skills and/or knowledge of individual users in order to solve complex search tasks.This tutorial will first give an overview of the ways into collaboration has been implemented in IR models with the attempt of improving the search outcomes with respect to several tasks and related frameworks (ad-hoc search, group-based recommendation, social search, collaborative search). Second, as envisioned in collaborative IR domain (CIR), we will focus on the theoretical models that support and drive user-to-user collaboration in order to perform shared IR tasks. Third, we will develop a road map on emerging and relevant topics addressing issues related to collaboration design. Our goal is to provide participants with concepts and motivation allowing them to investigate this emerging IR domain as well as giving them some clues on how to tackle issues related to the optimization of collaborative tasks. More specifically, the tutorial aims to: 1. Give an overview of the key concept of collaboration in IR and related research topics; 2. Present state-of-the art CIR techniques and models; 3. Discuss about the emerging topics that deal with collaboration ; 4. Point out some challenges ahead

Estimation of bivariate excess probabilities for elliptical models

Let $(X,Y)$ be a random vector whose conditional excess probability $\theta(x,y):=P(Y\leq y | X>x)$ is of interest. Estimating this kind of probability is a delicate problem as soon as $x$ tends to be large, since the conditioning event becomes an extreme set. Assume that $(X,Y)$ is elliptically distributed, with a rapidly varying radial component. In this paper, three statistical procedures are proposed to estimate $\theta(x,y)$ for fixed $x,y$, with $x$ large. They respectively make use of an approximation result of Abdous et al. (cf. Canad. J. Statist. 33 (2005) 317--334, Theorem 1), a new second order refinement of Abdous et al.'s Theorem 1, and a non-approximating method. The estimation of the conditional quantile function $\theta(x,\cdot)^{\leftarrow}$ for large fixed $x$ is also addressed and these methods are compared via simulations. An illustration in the financial context is also given.Comment: Published in at http://dx.doi.org/10.3150/08-BEJ140 the Bernoulli (http://isi.cbs.nl/bernoulli/) by the International Statistical Institute/Bernoulli Society (http://isi.cbs.nl/BS/bshome.htm

Report on the Second International Workshop on the Evaluation on Collaborative Information Seeking and Retrieval (ECol'2017 @ CHIIR)

The 2nd workshop on the evaluation of collaborative information retrieval and seeking (ECol) was held in conjunction with the ACM SIGIR Conference on Human Information Interaction & Retrieval (CHIIR) in Oslo, Norway. The workshop focused on discussing the challenges and difficulties of researching and studying collaborative information retrieval and seeking (CIS/CIR). After an introductory and scene setting overview of developments in CIR/CIS, participants were challenged with devising a range of possible CIR/CIS tasks that could be used for evaluation purposes. Through the brainstorming and discussions, valuable insights regarding the evaluation of CIR/CIS tasks become apparent ? for particular tasks efficiency and/or effectiveness is most important, however for the majority of tasks the success and quality of outcomes along with knowledge sharing and sense-making were most important ? of which these latter attributes are much more difficult to measure and evaluate. Thus the major challenge for CIR/CIS research is to develop methods, measures and methodologies to evaluate these high order attributes